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Abstract: In this note we recall the importance of the notion of a finitary 
isomorphism in the classification problem of dynamical systems. 



1. Introduction 

The notion of isomorphism of dynamical systems has been an object of an exten- 
sive research from the very beginning of the modern study of dynamics. Various 
invariants of isomorphism have been introduced, like ergodicity, mixing of different 
kinds, or entropy. Still, the task of deciding whether two dynamical systems are 
isomorphic remains a notoriously difficult one. 

Independent processes, referred here to as Bernoulli schemes (defined below), are 
most easily described examples of dynamical systems. However, even in this simplest 
situation, the isomorphism problem remained a mystery from around 1930, when 
it was stated, until late 1950's, when Kolmogorov implemented Shannon's ideas 
and introduced mean entropy into ergodic theory; later Sinai was able to compute 
entropy for Bernoulli schemes and show that Bernoulli schemes of different entropy 
were not isomorphic. 

In his ground-breaking work Ornstein (see 20\) produced metric isomorphism 
between Bernoulli schemes of the same entropy, and later he and his co-workers 
discovered a number of conditions which turned out to be very useful in studying 
the isomorphism problem. Among those conditions are notions of Weak Bernoulli, 
Very Weak Bernoulli and Finitely Determined. As those will not be of our interest 
in this note, we shall not go into the details, and the interested reader should for 
example consult or [2J|. What is relevant for us here is the fact that the map- 
pings which Ornstein constructed had the following disadvantageous property: in 
order to determine a target sequence one should examine the entire input sequence 
(the whole infinite past and future). On the other hand, it seemed necessary for 
applications that the codes should enjoy some kind of continuity property. 

2. Finitary Codes 

Numerous attempts had been done, after Kolmogorov introduced entropy into the 
study of dynamical systems, to construct effective codes between independent pro- 
cesses and between Markov processes. Meshalkin Blum and Hanson 0, Mon- 
roy and Russo |l8|, among others, have successfully constructed isomorphisms be- 
tween specific independent or Markov processes, and all of those codes enjoyed the 
following property: to determine a value of any given coordinate in an output se- 
quence, one should only examine finitely many coordinates of the source sequence, 
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this finite number of coordinates depending upon the input sequence under consid- 
eration. 

A fundamental object of our study is a dynamical system: a Lebesgue probability 
space (X, A, fi) together with a measure-preserving, ergodic automorphism S of X. 
However, as it is well-known ('|l4j') that every ergodic dynamical system of finite 
entropy can be represented as a shift transformation on a sequence space with a 
finite underlying alphabet, from now on we shall focus our attention to the case of 
sequence spaces. Consequently, we assume that X is a sequence space, A is a product 
er-algebra generated by the coordinate mappings, S is the left shift transformation 
and /i is a shift-invariant measure. We are now ready to define the principal objects 
of our interest. 

Definition 1. A homomorphism (factor map) ip from a dynamical system (X,A, 
fi, S) to a dynamical system (Y, B, v, T) is a measurable map 4> from a subset of 
measure one of X to Y such that v — and 4>S — Tcf>. The homomorphism 4> is 

called finitary if it becomes a continuous map after discarding subsets of measure 
zero from both spaces X and Y . 

If 4> is invertible and </> -1 is continuous outside subsets of measure zero, then we 
call <j) a finitary isomorphism. 

For shift spaces, an equivalent definition is the following: 

Definition 2. A homomorphism <fi between X and Y is finitary if for almost every 
x G X there exist positive integers q = q(x), r = r{x), q < r, such that if y G X and 
[x- q , . . . , x r ] = ...,y r ] and if <j>(y) is defined, then {(f>(x)) = {<j){y))o- 

Let us note in passing that definitions of almost-continuity can be given in a 
more general setting, and for this we refer the interested reader to 

The following random variable, called code length function, will be of special 
interest to us: 

Definition 3 (code length). For x G X, let q = q(x) and r = r(x) be minimal 
positive integers, as in the previous definition. The code length for x G X is C(x) — 
q{x) + r(x). 

Random variables q and r are sometimes called memory and anticipation of the 
coding, respectively. 

Definition 4. We say that dynamical systems are finitarily isomorphic with finite 
expected code times (feet) if both the finitary isomorphism 4> and its inverse 0" 1 
have finite expected code lengths. 

A systematic study of finitary coding had begun with the works of Keane and 
Smorodinsky ([HI, [ij, E3). and Denker and Keane (0, @). In their 1977 paper 
[TfH - and in subsequent articles 0], 0, Keane and Smorodinsky developed a 
theory and methodology of finitary coding, creating a new area of research, which 
has been (and is still being) extended in a multitude of ways. In this note we want 
to recall the marker methods of an d later discuss the existence of finitary 
homomorphism with finite expected code length or a finitary isomorphism with 
feet. 

It is perhaps worth noticing here that, despite major developments in the field, 
some of the most fundamental questions regarding classification remain open for 
more than 20 years now. 
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2. 1 . Case of different entropies 

In this section we recall the main ideas behind the Keane-Smorodinsky construction 
[Io| . The basic object of our study is a space of doubly- infinite sequences drawn 
from a finite alphabet consisting of a symbols (a > 2), X = {1, . . . , a} z , equipped 
with the product cr-algebra A, product measure fj, = p z and the left shift transfor- 
mation S. Here p = (pi, . . . ,p a ) is a strictly positive probability vector assigning 
probabilities to symbols 1, . . . , a. A quadruple 

(A, A, fi, S) 

is commonly referred to as a Bernoulli scheme based on a probability vector p, 
and will be denoted BS(p). It is well-known that the entropy of BS(p) equals 
h = h(p) = —J2iPi\°EPi- We will need another Bernoulli scheme, BS(q), based 
on a probability vector q = (<?i, . . . , (ft) on 6 symbols, here the shift space is X — 
{1, . . . , 6} z , the product cr-algebra is B, product measure is v = q z and the left shift 
transformation is T, entropy of T is h — h(q). In 1969 Ornstein (see j2jj) proved 
that Bernoulli shifts of the same entropies were isomorphic and also showed the 
following: 

Theorem 1. If h > h then Bernoulli scheme BS(q) is a homomorphic image of 
BS(p). 

Later (01) Keane and Smorodinsky strengthened both the unequal and equal 
entropies statements to the case of finitary coding. In this section we want to focus 
on the following statement: 

Theorem 2 ([10]). If h > h, then there exists a finitary homomorphism from 
BS(p) to BS(q). 

Before we continue, let us mention that the isomorphism result 0] relies upon 
a beautiful refinement and improvement of the methods developed for unequal 
entropies case. An excellent exposition of the finitary isomorphism result (which 
has become standard in ergodic theory) appeared in Petersen's book [24| (see also 
or H|). 

We now proceed to describe the Keane-Smorodinsky construction (see also jjj|) 
in the case of unequal entropies, and then recall some subsequent results in which 
the new techniques were applied. 

Basic reduction allows to assume that there are two blocks, called markers, one 
in each scheme, of the same length and the same probability of appearance; it is also 
quite natural to demand that the coding procedure should map markers to markers, 
the main difficulty is in inventing a code for blocks, called fillers, occurring between 
markers. We define a marker, for either scheme, to be a block 

M = l k ~ l 2 = 1 . . .1 2, 

{k— 1) —times 

consisting of k — 1 consecutive l's followed by a 2. Let us note that a marker has 
the following non- overlapping property: none of its initial subblocks is equal to its 
terminal subblocks of the same length; this property guarantees the shift-invariancc 
of the coding. 

By ergodicity, almost every source sequence a; in A splits into runs of markers la- 
beled in a natural manner by ±1, ±2, . . . and separating blocks labeled 0, ±1, ±2, . . . 
We assume that the 0-th coordinate of x is covered by either the run of markers 
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labeled —1 or the subsequent 0-th separating block. By uj we denote the number of 
markers in the j-th run while lj stands for the length of the j-th separating block. 

For every r = 1,2,... we denote by s r — s r (x) the skeleton of rank r. This is 
defined as the truncation of a; to a finite segment around such that the separating 
blocks in x are replaced by gaps of the same length, and with the property that 
the extreme left and right runs of markers contain each at least r markers while 
the internal runs, if any, contain each less than r markers. Moreover, neither the 
immediately preceding nor the immediately following fc-block of a; is a marker block. 
We denote by — m r < and n r > the label of the first and the last run of markers 
in s r , respectively. We may draw the following picture of the skeleton s r (x) of rank 
r at x, as a sequence of markers and spaces between the markers: 

M u- m . . . _ M u-i M m M""- 1 — M u " 

'-(m-l) l-l Iq h ln-1 

where m = m(r),n = n(r) > 1, Zj > 1, for i = — (m — 1), ... ,71 — 1 and U— m ,u n > 
r > u_ (m _ 1} , . . . ,it n _i. 

Clearly the rank one skeletons consist of two marker runs separated by one filler 
block. In order to avoid ambiguity we assume that the zero coordinate of x appears 
in the 'interior' of s±(x), i.e. it corresponds to the blank part of s±. The skeleton of 
rank r is obtained by looking to the left and to the right for the first appearance 
of M r . For a skeleton s we denote by l(s) the length of s minus the last run of 
markers, 

l(s r ) — ku- mr + l-„ lr +i + ■ • • + ku-i + lo + kui + • • • + l nr -i, 

as the final block of markers is only needed to determine the occurrence of s r (x) 
but is not considered to be part of that occurrence. A block in x occurring along 
a single run of markers followed by a separating block will be called an order one 
filler. The concatenation of all the order one fillers in s r will be referred to as the 
filler of s r - Clearly the length of the filler is equal to l(s r ). 

For a fixed non-indexed skeleton s the filler measure /i s is defined on the l(s)- 
blocks as the projection of the conditional measure n(-\S) where S is the event that 
s occurs at [0, l(s) — 1] in x. According to 10], the filler measure /i s is the product 
of the filler measures corresponding to order one subskeletons of s. Regardless of 
the skeleton rank, filler measures will be denoted by 

Recall that the marker process is a stationary 0-1 process X defined by Xi = 
iff Xi . . . x i+ k~i is a marker block. If the marker length k is sufficiently large then 
the entropy of the marker process can be made as small as needed. It is clear that 
both Bernoulli schemes have the marker process as a common factor, and that the 
skeleton structure at x only depends upon the marker process x. We define the filler 
entropy f = h(X) - h{X). 

Let us fix e < (/ — h)/3. A filler F in the skeleton s r (x) of the source sequence 
x £ X, is called good if fJ- s (F) < e~ l ^ Sr ^~ e \ On the other hand, a, corresponding 
Z(sr)-block F in x & X will be called a good filler if p,(F) > e ~ l ( Sr ^ h+€ \ According 
to |l0|. only good fillers will be encoded to good fillers. If a filler is bad, it will be 
encoded as a part of a longer good filler at a later stage. The coding is carried out for 
a given source sequence x by looking at the ascending skeletons s r (x), r = 1, 2, . . . 
By means of an "assignment" defined in |J{j> t ne filled skeleton s r (x) will be encoded 
in a consistent way if the filler F is good, except for a small set of exceptional cases. 
Let us now be more specific about the coding procedure. 

The set of all possible fillers ^"(s r ) for the low entropy scheme is divided into 
equivalence classes. If F S T{s r ) is good then no other filler in J-(s r ) is equivalent 
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to it. Let us suppose that F is bad; it is then possible that the restriction of F 
to a subskeleton s' of s r is a good filler for that subskeleton s'. The equivalence 
class of a bad filler F consists of all bad fillers G with the property that G has 
the same collection (as F) of subskeletons on which its restrictions are good, and 
those good restrictions agree with the corresponding (good) restrictions of F. Let 
us write F ~ G if F and G are equivalent. A simple combinatorial argument in |ld| 
guarantees that there are no more than 2 mr+nr ^ 1+t ^ h+, ^ li -- Sr ^ equivalence classes in 
T(s r ); we shall need that estimate later. An important step toward defining the 
desired code is a notion of partial assignments. For a fixed skeleton s, a partial 
assignment P s assigns to each element F of JF{s) a subset P S (F) of J 7 (s), in such a 
way that 

v*{F) <ti s (Ps(F)). 

Partial assignment is an example of a more general notion of a society (for a detailed 
discussion of societies see ^3 or 0|)- The partial assignment P s is good, if it 
respects the equivalence classes of F(s), i.e. if 

F ~ G P S {F) = P S (G). 

If we suppose that F ~ G, then the above condition guarantees that each filler F in 
P s (F) will be assigned to F and G and all other elements of the equivalence class of 
F. The Shannon-McMillan-Breiman theorem implies, however, that at some finite 
stage F becomes a part of a longer good filler H <E F(s r ) for a skeleton s r which 
has s as a subskeleton. Since H is good, no other element of T(s r ) is equivalent to 
it, and each F € P Sr (H) is assigned to exactly one filler in T(s r ), that filler being 
of course H . Keane and Smorodinsky show in 10], using a version of the marriage 
lemma, that partial assignments can be consistently extended to so-called global 
assignments, in such a way that if at a finite stage of the above procedure a filler 
F G 3~{s) is assigned to the unique F 6 F(s), then the assignments which take 
place for skeletons for which s is a subskeleton, respect the F i— ► F assignment. 
Finally, F is defined as a homomorphic image of F. A natural question which one 
might ask, having constructed a finitary coding, is whether the average code length 
is finite? Even though it was believed that the expected code length should be 
finite in the case h (p) > h(q), the proof of this statement, quite nontrivial, was 
given much later in [30|. Shortly after ^(|> Akcoglu, del Junco and Rahe extended 
the result of Keane and Smorodinsky. They constructed a finitary coding between 
an ergodic Markov shift X and a mixing Markov shift Y of smaller entropy. Their 
construction is quite similar to that of ^| , the essential role is being played by the 
low entropy marker process. Informally speaking, the presence of markers makes it 
possible to represent almost every source sequence x S X as an ascending nested 
family of words, which fill longer and longer skeletons determined by the marker 
process. Fillers of sufficiently large rank are encoded to corresponding fillers in Y 
thus eventually defining the required finitary coding <fi : X — > Y. Akcoglu, del 
Junco, and Rahe also claim without proof that the code length should have a finite 
expectation. We will now very shortly sketch the proof of the main result in ||, 
which is a significant improvement of the result in |30|. that the expected code 
length between Markov processes of unequal entropies is finite; we also indicate a 
number of differences between and 0, as we proceed. 

One of the differences between ^(j and Q lies in the choice of markers. Unlike 
in 01 j where the authors used I fc_1 2 as a marker, in the Markov case a marker 
M is a collection of blocks of the same length k such that each word in M begins 
with the same symbol ax, no word in M overlaps a word in M and arbitrarily long 
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concatenations of words from M occur with positive probabilities. Also, the length 
k can be chosen arbitrarily large and the probability that a marker occurs at a 
given position decays exponentially with k. 

The coding between two mixing Markov processes is achieved in two steps, as 
a composition of two codes, using an intermediate Bernoulli scheme. In the first 
step, referred to as Markov-to-Bernoulli coding, we study a mixing Markov process 
(X,/i,T) and a Bernoulli process (X,p,,T) with h(X) =h<h = h(X). A marker 
in X can be selected as a single word a\ . . . cifc in such a way that the filler entropy 
/ still exceeds the entropy h; no marker is needed in the Bernoulli process X. 
Good and bad fillers are defined similarly as in the Bernoulli case, and the coding 
procedure follows to a large extent that of [10| . 

As far as the code length is concerned, the main results of jg| are the following: 

Theorem 3. Let the processes X, X be mixing Markov and Bernoulli (or Bernoulli 
and Markov), respectively. If h(X) > h(X) then there exists a finitary coding from 
X to X such that for every p < 2 the code length is an L p random variable. 

Lemma 1. Let X,Y,Z be arbitrary stationary processes and let <fi : X — > Y and 
ip : Y — > Z be finitary codes. Assume that for some p\,pi > 1 with p\ < p2 + 1 the 
code length of <f> is in L p for all p < p\ and the code length of tp is in L p for all 
p < p2- Then the composed code rpocj) has code length in L p for allp < Pi£>2/(P2 + 1)- 

Composing the Markov-to-Bcrnoulli with Bcrnoulli-to-Markov codes, we obtain: 

Theorem 4. Let X\ and Xi be mixing Markov processes such that h(X±) > h^X^). 
Then there exists a finitary coding from X\ to X2 such that the code length is in 
L p for all p < 4/3. 

Let us recall a basic fact about the nature of the Keane-Smorodinsky coding, 
that markers are mapped onto markers and fillers onto fillers, so the contents of 
good skeletons in one scheme define the contents of appropriate skeletons in the 
other scheme. Consequently, the code length function C only takes values c r+ i = 
k + l(s r+ i) + k(r + 1) (depending upon the marker process), which are skeleton 
lengths plus the length of r + 1 markers in the terminal marker occurrence plus 
k which stands for a number of entries which have to be examined to make sure 
that there is no marker preceding the initial run of markers. From a combinatorial 
bound on the number of equivalence classes in F(s r ) it follows that the conditional 
probability, given a marker structure of x, that C(x) > cv+i, is bounded by (see 
H3, lemma 14) 

2 m r +n r -cl(.s r ) + ig bad ) + if , bad ^ 

where c = (f — h — 2e) / log 2 > and F, F denote the s r -fillers in X, X, respectively. 
It is easy to see that EC P is finite if E c r+i p P{C > c r+1 ) < 00, so it suffices to 
show that the three following series converge 

00 00 oc 

J2 E{c r+1 p 2 m ^- cl ^), E(c r+1 P ti s (F is bad)), £ E(c r+1 p fi(F is bad)). 

r—l r—1 r—1 

Convergence is obtained by a careful study of analytic properties of the generating 
function of the filler length, the use of the Bernstein inequality to give exponential 
bounds for appropriate large deviation events, and repeated use of Holder inequality. 

The second step is a Bernoulli-to-Markov coding. Now X is Bernoulli and X is 
mixing Markov with h(X) — h < h = h(X). Moreover, as in 0, by extending X 
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to another mixing Markov process with a slightly larger entropy (the extension is a 
coding of length one) we may assume that there exist a marker M in X and a single- 
word marker M in X such that the corresponding marker processes have the same 
distribution. Therefore the two marker processes can be identified as a common 
factor X of X and X. The bad fillers in X and X are defined as in the Markov- 
to-Bcrnoulli case and the finiteness of EC P is concluded similarly by studying the 
three series (with some additional difficulties caused be the fact that the image is 
a Markov and not independent process). 

Remark 1. The above methods allowed to compute moments of order p with p < 2 
for Markov-to-Bernoulli and Bernoulli-to-Markov coding, and left an open question 
whether the variance of the coding is finite. In a yet unpublished manuscript 
the authors claim that there exists a universal finitary coding between Bernoulli 
schemes of unequal entropies which has exponential tails, i.e. Prob(C > n) decays 
exponentially as n — > oo, a condition which clearly implies that moments of all 
orders are finite. A code is universal in the following sense: if A and B are two 
alphabets, and a Bernoulli scheme on B is given, of entropy h, and in addition an 
e > is given, then there exists a measurable subset of A 1, and a mapping </> from 
that set to B z such that if any Bernoulli scheme on A is given, of entropy larger 
than h + e, then <fi is finitary with exponential tails. 

Let us note, however, that this result does not imply that the Keane-Smorodinsky 
code has finite variance. 

2.2. Case of equal entropies 

In |lH Keane and Smorodinsky improved upon the result of Ornstein and showed: 
Theorem 5. If h(p) = h(q), then BS(p) and BS(q) are finitarily isomorphic. 

A question was immediately posed as to under what additional assumptions the 
expected code length could be finite. It was known already that in the case of 
Meshalkin's code, the average code length was infinite, as for that particular code 
the probability Prob(C > n) is equal to the probability that a simple random walk 
remains positive after n steps. 

First general statement in this direction was made by Parry (|2l|). who provided 
a class of isomorphisms which had infinite expected code lengths, and therefore 
showed that entropy alone was not an invariant for finitary isomorphism with feet. 
An obstruction which was discovered by Parry involved the so-called information 
cocycle. Let us suppose that a = {A\, . . . , Ak} is a time-zero partition (also called 
state partition) of the shift space (X,S,fj,), that is, A4 — {x : xq — i}. Let ot~ 
denote the smallest cr-algebra containing Vi=i S~ l a, and define the information 
cocycle of S to be 



Theorem 6. If S and T are finite state processes and if (p is a finitary isomor- 
phism between S and T such that 4> and _1 have finite expected code lengths, then 
the information cocycles Is and It ° 4> are cohomologous, with a finite valued and 
measurable transfer function, i.e. Is = It°4> + 9°S — g. 




In [2l| Parry proved: 
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Note that here the dynamical systems were not assumed to be Markov. 

It was then shown by Parry that particular dynamical systems which were known 
to be finitarily isomorphic by the results of Keane and Smorodinsky, had non- 
cohomologous information cocycles and therefore could not be finitarily isomor- 
phic with feet. Among the above was Meshalkin's example of Bernoulli schemes 
BS(^, |, |, |, |) and BS(j, j, j, j) and some equal entropies Markov processes. 
First attempt in forming a set of invariants for isomorphism with feet between 
Markov shifts, was undertaken by Krieger. He (in [l^J) defined, for a Markov shift 
with transition matrix P, a multiplicative subgroup Ap of positive reals in the 
following way: 

P(io,h)---P(jn-i,io) 
which are ratios of weights of cycles of equal lengths starting and ending in the 
same state. Krieger was then able to prove that if Markov shifts P and Q were 
finitarily isomorphic with feet then their respective delta groups Ap and Aq were 
equal. He also gave examples of shifts with equal delta groups which could not be 
finitarily isomorphic with feet. 

In 1981 Tuncel (0) introduced the so-called /3-function, as the spectral radius 
of the matrix P* (where P t {i 1 j) — (P(«, i))*)> and showed that this was an invariant 
of regular isomorphism. We shall not go into a detailed study of the classification 
up to a regular isomorphism; let us only note that this is a weaker notion than 
finitary isomorphism; an isomorphism (f) is regular if both 4> and its inverse <f>~ x 
have bounded anticipation but can have infinite memory. Later Schmidt (|28j. see 
also |29jfimnroved on some of the results of Tuncel, showing in particular that 
[3- function was an invariant for finitary isomorphism with feet. 

In 1984 Parry and Schmidt (H^j) extended the notion of Ap-group to that the 
Pp-group, generated by all weights P{io,i\) • ■ ■ P(i n -i,io) of cycles. They showed 
that for an aperiodic transition matrix P, the quotient group V p I A p is cyclic with 
a distinguished generator cpAp. The main statement of |22j is that Tp, Ap and 
cpAp are invariants for finitary isomorphism with feet, which together with the 
previous result of Schmidt allowed to establish the following conjecture. 

Conjecture 1. The quadruple (rp, Ap, cpAp, (3p) forms a complete set of invari- 
ants for finitary isomorphism with feet. 

The above has been open for twenty years now, and the most general statement 
seems to be a recent result of Mouat and Tuncel: 

Theorem 7 ([19]). Let P andQ be primitive, stochastic matrices of the underlying 
Markov shifts, with the same T, A, cA and (3 invariants. If there exist states Iq, Jq of 
the P-shift and the Q-shift, respectively, and there exist a nontrivial column vector 
v r and a nontrivial row vector V; such that (P n v r )(I ) — (v;Q™)(Jo) for all n>l, 
then the two Markov shifts are finitarily isomorphic with feet. 

3. Applications 

In this section we discuss a number of results which are closely related to finitary 
coding. 
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3.1. m- dependent processes 

The marker method of and ^1 was extended by Smorodinsky ( |31|1 to prove 
that m-dependent processes of equal entropy were finitarily isomorphic. Let us 
recall here that a stationary process is called m-dependent if its past and future 
become independent, if separated by m units of time. It is an easy observation 
that processes which are finite factors of independent processes are m-dependent, 
so Smorodinsky's result implies that equal entropy, finite factors of independent 
processes are finitarily isomorphic. It is natural to ask about finitary instead of 
finite factors, and this is stated in [^H as a conjecture: 

Conjecture 2 (Finitary factors conjecture). Equal entropy, finitary factors of 
independent processes are finitarily isomorphic. 

Let us keep in mind a well-known fact from Ornstein's theory that measurable 
factors of independent processes are (measurably) isomorphic, if they have the same 
entropy. 

3.2. Z d -actions 

Another direction in which the results of ^3 have been extended is the action of Z d , 
d > 2, rather than the action of a single shift on Z. In del Junco considered two 
random fields on Z 2 : an ergodic Markov field X and an independent process Y such 
that h(X) > h(Y). He then proved the existence of a finitary homomorphism from 
X to Y. It was left as an open question whether a mixing Markov field was always 
a finitary factor of a Bernoulli process of higher entropy. Later (0j) an example was 
given by van den Berg and Steif, of a Markov field which was not a finitary factor 
of any independent process, so the finitary factors conjecture fails in d dimensions, 
d > 2. 

Among the difficulties which arise when one considers Z 2 actions instead of a 
Z action is the choice of markers. Let us recall that markers were nonoverlapping 
blocks; a marker in Z 2 should therefore be a block which does not overlap itself under 
translation in any given direction, and that is a hard condition to fulfill, del Junco 
considers a multidimensional version of the Rokhlin tower lemma in order to define 
configurations in Z 2 which have a number of disjoint shifts and which, together with 
a specific number of its shifts, almost cover the whole space; those configurations 
depend upon the multiple occurrences of blocks called markers. Skeletons of all 
ranks are defined in a highly nontrivial w ay, s ubsequently del Junco adapts and 
modifies when necessary the main ideas of |lOj . including the marriage lemma, to 
build the desired finitary coding between the random fields. 

We complete this section by mentioning that it is the subject of the current 
research of the author of this note to show that the average code volume for the 
finitary coding from a Markov random field into a Bernoulli field of strictly smaller 
entropy, is finite. The generalization of the notion of code length to that of code 
volume in Z 2 is straightforward. We do, however, propose an alternative approach 
to that of del Junco. A marker is a fixed block of a low probability of occurrence; 
when a marker occurs at a fixed coordinate, we consider a skeleton at this coordinate 
as a set of coordinates for which this marker occurrence is the closest, in the L\- 
distance. This procedure gives rise to the partition of Z 2 , into the so-called Voronoi 
regions; the details will appear elsewhere. 

A result of different flavor was obtained by Steif in [33], where he considered 
the so-called T, T _1 process (also known as Random Walk in Random Scenery) 
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in d-dimensional integer lattice (for definitions see |32( and references therein). A 
classical result of Kalikow is that the T, T _1 process on Z associated to a simple 
random walk is not Bernoulli; Steif proves that in Z d the second coordinate of this 
process is not a finitary factor of an independent process, he also applies this to 
study some properties of the Ising model in statistical mechanics. 

3.3. Countable state processes 

It turns out that the assumption that a Markov shift be a finite state process, is 
an essential one, as far as classification up to a finitary isomorphism is concerned. 
Smorodinsky proved (unpublished, see e.g. flij ]) that an ergodic automorphism of 
compact abelian group can only be finitarily Bernoulli (that means: finitarily iso- 
morphic to a Bernoulli shift) if it is exponentially recurrent (i.e. if U is an open set 
and rjj is the first-return time function, then Prob(r;y > n) decays exponentially 
fast with n). Smorodinsky used this result to construct a countable state Markov 
shift which is measurably isomorphic to a Bernoulli shift but has polynomially de- 
caying return times, hence cannot be finitarily isomorphic to a Bernoulli scheme. 
Lind ( 16]) went on in that direction to prove that ergodic automorphisms of com- 
pact abelian groups are exponentially recurrent, and that was a step forward in 
trying to resolve a question as to whether ergodic group automorphisms are finitar- 
ily isomorphic to Bernoulli shifts. Let us recall here that some special classes, like 
hyperbolic toral automorphisms, are known to be finitarily Bernoulli. 

Rudolph ([13) completed Smorodinsky's work in showing that a countable state, 
mixing Markov shift of finite entropy is finitarily Bernoulli if and only if the chain 
has exponentially decaying return times; in particular, it follows that the so-called (3- 
automorphisms arc finitarily isomorphic to independent processes of the same finite 
entropy We wish to note that this result depends heavily upon the characterization 
of the processes finitarily isomorphic to Bernoulli shifts (|26j), a construction which 
is a very involved generalization of More recently, Keane and Steif (^3) proved 
that T, T -1 process associated to a 1-dimensional random walk with positive drift 
is finitarily isomorphic to an independent process, using an intermediate countable 
state Markov shift, and results of 1271 . 

Finally, we remark that Petit ( 25]) extended the methods of Keane and Smoro- 
dinsky f|ll|) to show that two infinite entropy Bernoulli schemes on countable state 
space are finitarily isomorphic. 

Let us close this paragraph by mentioning that despite all developments, the 
classification of countable state Markov processes up to a finitary isomorphism 
remains an intricate task, and there seems to be a need for methods which would 
both be more elementary and more easily understood than the present ones. 
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